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pH ■ Abstract 

We study combinatorial procurement auctions, where a buyer with a valuation function v and 
y^ budget B wishes to buy a set of items. Each item i has a cost Cj and the buyer is interested in a 

set S that maximizes v(S) subject to Hi^sCi < B. Special cases of combinatorial procurement 
auctions are classical problems from submodular optimization. In particular, when the costs 
are all equal [cardinality constraint), a classic result by Nemhauser et al shows that the greedy 
algorithm provides an — ^r approximation. 

Motivated by many papers that utilize demand queries to elicit the preferences of agents in 

economic settings, we develop algorithms that guarantee improved approximation ratios in the 

presence of demand oracles. We are able to break the — §j- barrier: we present algorithms that 

t — ■ ■ use only polynomially many demand queries and have approximation ratios of I + e for the 

general problem and | for maximization subject to a cardinality constraint. 

We also consider the more general class of subadditive valuations. We present algorithms 
that obtain an approximation ratio of 2 + e for the general problem and 2 for maximization 
subject to a cardinality constraint. We guarantee these approximation ratios even when the 
valuations are non-monotone. We show that these ratios are essentially optimal, in the sense 
that for any constant e > 0, obtaining an approximation ratio of 2 — e requires exponentially 
many demand queries. 
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1 Introduction 

We study the following combinatorial procurement auction problem: a buyer with a valuation v 
and budget B wishes to purchase a set of items S, where each item i has a cost Cj. The buyer is 
interested in maximizing his value v(S) while not overspending (£j g £Cj < B). 

Truthful mechanisms for various variations of this problem were studied in [26] and its followup 
[9]. In this paper we study the problem from a pure combinatorial optimization point of view. This 
is analogous to the combinatorial auctions literature, where one branch studies incentives issues 
(e.g., [U EQj El E] ) , and the other studies the problem as a pure combinatorial optimization problem 
ignoring incentives (e.g., [22J OS EH 13 CED El CEDJ ) • 

We focus on cases where the valuation function v is submodular (for each two sets S and T, 
v(S)+v(T) > v(SUT)+v(SnT)) or subadditive (for each two sets S and T, v(S)+v(T) > v(SUT)). 
Submodular valuations capture cases where the buyer exhibits decreasing marginal utilities, and 
subadditive valuations capture complement freeness. See, e.g., [22], for a more elaborate discussion. 

When v is submodular a combinatorial procurement auction is a reformulation of a classical 
problem from submodular optimization, maximization subject to a knapsack constraint: each item 
i has a cost c, and the goal is to find a maximum- value set S such that Ejg^Cj < B, for a given 
budget B. A special case is maximization subject to a cardinality constraint: find a set S of size k 
with the highest value. Many other generalizations and variants of this problem were studied (e.g., 

pa EH El EH ESI 0). 

We want our algorithms to run in time polynomial in n, the number of items. However, the 
valuation function is an object of size 2 m . The combinatorial auctions literature therefore usually 
assumes that access to the valuation is done via an oracle. Two types of queries were extensively 
studied: value queries (given a set S, return v(S)) and demand queries (given prices pi, . . . ,p m 
return a set S such that S € argmaxT'u(T) — T,j £ tPj)- Here we use demand queries to solve 
the combinatorial procurement auctions problem. This path was already taken in [9], but let us 
mention two reasons: 

• Economic interpretation: many algorithms for economic settings, either truthful or not 
truthful, assume that the valuations are accessed via demand oracles (e.g., [T3 l [TT l l7ll8llTll2"0]). 
As was argued extensively in the literature (e.g., [H El EH [HI El]) demand queries are a natural 
way for agents to express their preferences. 



• Bypassing impossibility results: it is known that polynomially many value queries cannot 
guarantee an approximation ratio of n^~ e even for optimization subject to a cardinality 
constraint if the valuation of the buyer is subadditive [26, 7Jj. Hence we must use stronger 
oracles to achieve reasonable approximation ratios. 

The classical result in submodular optimization shows that the greedy algorithm provides an 
approximation ratio of ^r p3] for optimization subject to a cardinality constraint, and that this 
is the best possible with a polynomial number of value queries [23, 12]. We show that demand 
queries allow us to break the — §j barrier: 

Theorem: There exists a ^-approximation algorithm for the problem of maximizing a monotone 
submodular function subject to a cardinality constraint that makes a polynomial number of demand 
queries. For the problem of maximizing a monotone submodular function subject to a knapsack 



1 In fact this bound holds even if the valuation is fractionally subadditive - a valuation is fractionally subadditive 
(a.k.a. XOS) if it is the maximum of several additive valuations. A formal definition will be presented later. 



constraint, for every constant e > 0, there exists a (I + e)-approximation algorithm that makes a 
polynomial number of demand queries. 

We start by presenting a natural linear program. The dual of the linear program has exponential 
many constraints but only polynomially many variables, so we show that the dual can be solved via 
the ellipsoid method, using a demand query as a separation oraclqj. We show various structural 
properties of optimal solutions to the LP, e.g., there are at most two sets in their support. We now 
face an additional challenge: in general, none of these sets (or a part of them, in case they violate 
the cardinality constraint) provides a good enough approximation. The key step is showing that by 
taking one set and augmenting it using the other set we get a new combined set that does provide 
the specified approximation ratio. 

Next, we consider the class of subadditive valuations. In [9] a (2 + e) approximation was 
obtained for maximization subject to a cardinality constraint. On top of slightly improving this 
ratio, we present the first constant-approximation algorithm for maximization subject to a knapsack 
constraint, improving over the O(logm) ratio in [9]: 

Theorem: There exists a 2-approximation algorithm for the problem of maximizing a subadditive 
function subject to a cardinality constraint that makes a polynomial number of demand queries. 
For the problem of maximizing a subadditive function subject to a knapsack constraint, for every 
constant e > 0, there exists a (2 + e)-approximation algorithm that makes a polynomial number of 
demand queries. 

These algorithms do not assume that the valuation is monotone. In particular, the algorithms 
guarantee the specified approximation ratio also for non-monotone submodular valuations (a class 
that received much attention recently - see, e.g., [211 US El E]). In fact, we once again break the 
lower bound for approximation with value queries: it is known that a 2. 03- approximation algorithm 
for maximizing non- monotone submodular function must use exponentially many value queries |15j . 

We also show how to obtain purely combinatorial algorithms via a certain type of a natural 
"ascending auction", possibly with an additional augmentation step. An exciting direction is to 
analyze these auctions and similar ones from a more economic point of view, although we do not 
push this direction further in this paper. 

Our bounds have another implication: they enable us to construct a "monotone estimator" (in 
the language of [9]) and improve the best known approximation ratio of a deterministic truthful 
mechanism for maximizing subadditive valuation subject to a knapsack constraint to 0(log m). 
The best previously known bound for this setting was 0(log m) |9j. 

Are our bounds optimal? We provide an example with a matching integrality gap of | for 
optimizing monotone submodular valuations. For non-monotone submodular valuations we present 
an example with a matching integrality gap of 2. Moreover, we show that for subadditive valuations 
our results are optimal (in fact, they are optimal even if the function is known to be fractionally 
subadditive): 

Theorem: Fix some constant e > 0. Let A be a (possibly randomized) (2 — e)-approximation 
algorithm for maximizing a fractionally subadditive function subject to a cardinality constraint. 
Then, A makes exponentially many demand queries. 

We note that proving limits on the power of demand queries requires developing significant amount 
of novel machiner)0 The idea is to start with some specific valuation v, and obtain a valuation vt 



2 This first step is very similar to the use of demand oracles in algorithms for combinatorial auctions, where demand 
oracles are used to solve the LP [71 lllllT3| . but the similarity between the algorithms ends here. 

3 The most relevant lower bound that applies specifically to demand queries is that of Nisan and Segal [23] . 



by "planting" some bundle T of size k with high value. We would like to show that determining 
whether such planting occurred requires an exponential number of demand queries. The challenge 
here is that a single demand query can verify whether the valuation is vt for many bundles T 
simultaneously. Nevertheless, we show that the power of a single demand query is limited: for 
every demand query there exists a set of items (relatively small but of significant size) that is 
contained in all bundles T that the demand query simultaneously verifies. This enables us to upper 
bound the number of bundles that can be simultaneously verified by a single demand query, and 
suffices to derive the theorem. We also use this technique to rule out an FPTAS for maximizing a 
submodular function subject to a knapsack constraint. 

Open Questions 

In this paper we initiated the systematic study of optimization with demand queries. Let us now 
mention several intriguing questions that we leave open. The first obvious one is to determine the 
possible approximation ratio when the valuation of the buyer is submodular, both in the monotone 
and in the non-monotone cases. It is also interesting to understand the possible approximation 
ratios using different constraints. Examples include optimizing submodular functions subject to 
matroid constraint [141 EZ] > multiple knapsacks |17[ [18] and their combination |2H [5] . What is the 
approximation ratio possible if demand queries are available in all these settings? We make a first 
step in this direction by providing an 0{k) approximation algorithm for optimizing subadditive 
function subject to k knapsack constraints. We do not know neither whether this is the optimal 
ratio possible nor how to construct good algorithms for the other settings. 

Paper Organization 

Section[3]presents the LP for the problem and proves some structural properties of optimal solutions. 
In Section H] we give our l-approximation algorithms for submodular valuations. Section [5] provides 
approximation algorithms for subadditive valuations. We show that the algorithms for subadditive 
valuations are in fact optimal in Section [6j The proof that there is no FPTAS for submodular 
valuations subject to a knapsack constraint is also in that section. 

2 Preliminaries 

Valuations and Problems Definition 

Let M be a set of items, \M\ = m. Let v : 2 M — > R be a set function. We assume that u(0) = 0. v 
is monotone non- decreasing if for each SCT, v(S) < v(T). 

In this paper we are mainly interested in the following two problemsj: in the maximization 
subject to cardinality constraint problem we are given a number k, and we want to find the largest 
value set S, \S\ = k. In the maximization subject to budget constraint problem we are given a budget 
B and a cost q for each item i. The goal is to find the largest-value set S, such that Hj^s c j < B. 
We sometimes use the name maximization subject to a knapsack constraint for this problem. 

We consider this problem under various restrictions on the valuations. We say that v is submod- 
ular if for every S,T C M we have that v(S)+v(T) > v(S\JT)+v(Sr\T). v is subadditive if for every 
S, T C M we have that v(S)+v(T) > v(SUT). A valuation is additive ifv(S) = Y*j e sv({j})- Notice 
that every submodular valuation is also subadditive, and every additive valuation is submodular. 



However, the setting of [24] is much simpler, and their ideas do not seem to be applicable in our case. 
4 We also consider some generalizations, which will be defined in the proper subsections. 



Another type of valuations that we consider is fractionally subadditive (or XOS). A valuation 
is XOS if there exist additive valuations v\,...,vi such that v(S) = maxj Vi(S) (we say that i is a 
maximizing clause of S). It is known [22J that every XOS valuation is subadditive, and that every 
monotone submodular valuation is XOS, and that there are subadditive valuations that are not 
XOS, and XOS valuations that are not submodular. 

We sometimes use the notation v{S\T) to denote v(SUT)—v(T). For the problem of maximizing 
a function subject to budget constraint, we sometimes use the notation C(S) = S^ggCy. 

Demand Queries 

Given prices pi, . . . ,p m , a demand query returns a bundle S, S £ argmaxT v(T) — T,j^tPj- The 
set of bundles that achieve the max is called the demand set of the query. Our algorithms provide 
the guaranteed approximation ratio without making any assumption about which specific bundle 
is returned from the demand set. For lower bounds, as pointed out in [24J, some unnatural tie- 
breaking rules may supply unrealistic information about the valuation. Therefore, as in [24J, our 
lower bound assumes any tie-breaking rule that does not depend on the valuation, e.g., return the 
lexicographically- first bundle in the demand set. 

Another type of well-studied query is value query: given a set S, return v(S). It is known 
[4] that a value query can be simulated by polynomially many demand queries (but exponentially 
many value queries may be required to simulate a single demand query). This paper concentrates 
in designing algorithm with polynomially many demand queries, so we freely assume that we have 
access to value queries. 

3 The Structure of the LP 

Our algorithms are based on finding good roundings of fractional solutions. These fractional so- 
lutions are obtained by solving a natural linear relaxation of our problems. The key ingredient is 
analyzing the structural properties of optimal fractional solutions: we give limits on the number 
of elements in the support, analyze their costs, and give precise formulas for the weights of the 
elements in the support. 

The LP can be solved using demand oracles. Moreover, we show that there is a combinatorial 
method of obtaining solutions to the LP, using a process that can be viewed as an ascending auction. 

The LP is presented for the more general case of maximization subject to a budget constraint 
(maximization subject to a cardinality constraint is a special case where for each item i, Ci = 1 and 
B = k). 

Maximize: ^2 S xs ■ v(S) 
Subject to: 

• Z s xs-C(S)<B. 

• T,s x s < !• 

• For each bundle S: x$ > 0. 

Although the LP has an exponential number of variables, we show that it can still be solved using 
a polynomial number of demand queries: 

Proposition 3.1 The LP can be solved using a polynomial number of demand queries. 



Proof: Consider the dual of the primal LP: 

Minimize: y • B + z 
Subject to: 

• For each bundle S: z + y ■ C{S) > v(S). 

•V>0. 

• z >0. 

We use the ellipsoid method to solve the dual LP and thus obtain a solution to the primal LP. 
For the ellipsoid method to work we need to implement a separation oracle that finds some set 
S that violates the constraint y ■ C(S) + z > v(S). To do that, consider the demand query 
dq = y ■ (ci, . . . , Cm), and let T be the bundle that dq returns. If z > v(T) — y • C(T) then by the 
definition of demand query for every other set S we have z > v(T) — y • C(T) > v(S) — y ■ C(S). □ 
A key ingredient of our algorithms is the following structural property of the LP. 

Definition 3.2 A fractional solution is a strict solution if there are two variables xs ± and x$ 2 , 
such that C(Si) < B, C(S*2) > B, xs 1 = a, and xs 2 = 1 — a, where a = c(s-)-c(s ) • 

Proposition 3.3 Either there exists an optimal integral solution to the LP or there exists an 
optimal strict solution. Given an optimal solution to the LP, we can transform it in polynomial 
time to a fractional solution with the same value that is either integral or strict. 

Proof: Suppose that for each set S in the support of the solution we have that C(S) < B. In 
this case we claim that there is an integral solution, since m&x(v(S)\xs > 0) > Y2s XsV (S)- 

Consider now the other extreme case, where for each set S in the support of the solution we 
have that C(S) > B. In this case we show that there is a fractional solution with exactly one 
variable in the support: 



J2%Sv(S) = J^s^cj — 



v(S) 



c j 



s ies ^i^s c i 

i V (S) i n v^ v^ 

= max(- 1 x s > 0) • 2_^xs2_^ 

^3£S c i s jeS 

< max( "^ \x s >0)-B 

Let ^2 = arg max( y ^ ' - \xs > 0). In this case we set S*i = 0. Observe that by setting a = jjM \ 

we get a strict fractional solution with value at least equal to the value of the optimal fractional 
solution. 

The only case that is left to handle is the case where there are two sets with xs x , xs 2 > and 
C{S\) < B and C(S r 2) > B. We show a strict fractional solution that is optimal. By complementary 
slackness we have that z + y ■ C(S±) = v(Si) and z + y • C^) = v(S2)- Solving for z and y we get 
z = X cts Y-Cis ) anc ^ y = C(S 2 )-C(S ) • Hence the value of the optimal fractional solution is 

v(S 1 )(C(S 2 )-B)+v(S 2 )(B-C(S 1 )) 
C(S 2 )-C(Si) • 

Consider now the strict fractional solution xs 1 = C (s )-C(s l ' Xs 2 = c(s )-cts ) • ^ s vame ^ s 



exactly the value of the optimal fractional solution: C (s )-C(S ) ' v (Si) + C (s )~c(s 1 ' ^(^2) D 



C(5 2 )-C(5i)' ^^2 ~ C(5 2 )-C(5i)' 
C(S 2 )-C(Si) V( - bl ) + C(S 2 )-C(Si) 



We now present a combinatorial method of obtaining strict fractional solutions to the LP. An 
important advantage of this method is that it uses only uniform-price queries (unlike the previous 
LP-based approach that requires arbitrary demand queries). We make use of the following simple 
property of demand queries: 

Lemma 3.4 Let p = (pi, ...,p m ). Let Si be some bundle that maximizes the profit in prices Ai -p. 
Let £2 be some bundle that maximizes the profit in prices X2 • p. Then Ai < A2 if and only if 
^jeS x Pj > ^jeS 2 Pj- 

Proof: By the definition of demand query we have v(S2) — XiT,j € s 2 Pj < v(Si) — XiT,j £ SiPj 
and v(Si) — X 2 ^jeSiPj < v{S2) — X 2 T,j e g 2 pj. Adding the two inequalities and simplifying we get 
(Ai — X 2 )iT'j^s 2 Pj ~ ^jeSiPj) > 0. This implies the lemma. □ 

Definition 3.5 A > is the boundary if there exists Si, S2, C{S\) < B, C(S 2 ) > B, such that S2 
is in the demand set in prices X ■ (ci, . . . , c m ) and for every small enough 5 > we have that S\ is 
in the demand set in prices (A + <5) • (ci, . . . , c m ). We say that S\ and S2 are two boundary bundles. 

Let us further explain the notion of boundary bundles. For simplicity, this paragraph considers 
only the simpler cardinality constraint. Consider some prices A • (1, . . . , 1). When A = 0, the most 
profitable bundle consists of all items. Lemma 13.41 implies that as the value of A increases, the size 
of bundles in the demand set decreases (eventually, when A is big enough, the demand set will be 
empty). The boundary is the specific A for which the demand set in A ■ (1, . . . , 1) contains only 
bundles that violate the cardinality constraint, but for (A + e) • (1, . . . , 1) the demand set contains 
bundles that respect the cardinality constraint. 

The boundary bundles (and A) can be found by an ascending auction in which we continousljo 
increase the value of A and obtain a profit-maximizing bundle in the current prices. The boundary 
is the A for which the prices A • (ci, . . . , c m ) are the supremum of the points where supply exceeds 
demand. We were surprised to find that the boundary bundles define a high-value fractional 
solution: 

Lemma 3.6 Let S\ and S2 be two boundary bundles and let X be the boundary. Let a = r(s)-C(S ) ' 
Then xs ± = ct and xs 2 = 1 — a is a strict solution to the LP. Moreover, let O be the optimal integral 
solution. Then, xs 1 v(S±) + xs 2 v(S2) > v(0). 

Proof: To see that the solution respects the budget constraint: 

a.C(S l) + (l-a)-C(S 2 ) = ^"^ • C&) + ^ g^ ■ C(S 2 ) 

B(C(S 2 ) - C(5i)) 
C(S 2 ) - C(Si) 
= B 

As for the second part, Si and S2 are in the demand set of their respective prices, therefore: 

v(0)-(X + 8)-C(0) < v(S 1 )-(X + 6)-C(Si) 
v(O) - X ■ C(O) < v(S 2 ) - X ■ C{S 2 ) 



5 Of course, to obtain a discrete process one may increment A in some discrete amount. This results in some loss 
in the approximation ratios of the algorithms that we construct (the loss depends on the size of the increments) . 



Multiplying the first inequality by a, the second inequality by (1 — a), and summing up the two 
we get that (using B > C(0)): 



v(0) -(\ + 5)B + a5-B < a- u(5i) + (1 - a)v(S 2 ) - a ■ (A + S) ■ C(5i) - (1 - a) • A • C(S 2 ) 

w(5i) + (1 - 
5 - C(5i) 



a . v ( Sl ) + (1 - a)t;(S 2 ) - ^yz ^ ■ (A + *) ■ C(Si) 



C(S 2 ) - 0(5! 



A • C(5 2 ) 



= a • i,(5i) + (1 - a)v(S 2 ) -XB- -^± ^ • 6 ■ C(S 1 ) 
Rearranging both sides we get: 

v(0)-S-B + aS-B < a-v(S 1 ) + (l-a)v(S 2 )--£^—^--5-C(S l ) 
Now when we let S go to we get that xs 1 v(Si) + xs 2 v(S 2 ) > v(0), as needed. □ 

4 A |- Approximation for Monotone Submodular Valuations 

As we have shown, any strict solution to the LP with cardinality constraint contains two bundles, 
a "large" bundle with more than k items, and a "small" bundle with at most k items. A natural 
approach for an approximation algorithm is to select the maximum of the following two bundles: 
the "small" bundle, or an high- value chunk of size k from the "large" bundle. Unfortunately, there 
are examples that show that this approach cannot provide an approximation ratio better than 2. 
Hence, our strategy is subtler: we start with the small bundle and grab as much value as we can 
from the large bundle. We show that this combined bundle provides an approximation ratio of |. 
We also extend this algorithm to handle maximization subject to a knapsack constraint. Here 
the approximation ratio we get is slightly worse: §+£• We enumerate over all sets of high-cost items, 
then use a variation of our algorithm for a cardinality constraint as an algorithm for instances with 
only low-cost items. We complement these results by presenting an instance with an integrality 
gap of | (in the appendix), even for maximization subject to cardinality constraint. 

Theorem 4.1 The following algorithms exist: 

• A ^-approximation algorithm for the problem of maximizing a monotone submodular function 
subject to a cardinality constraint that makes a polynomial number of demand queries. 

• A (| + 0(e))- approximation algorithm for the problem of maximizing a monotone submodular 
valuation subject to a knapsack constraint that makes a polynomial number of demand queries, 
for any fixed e > 0. 

We start with the algorithm for the cardinality constraint. We first present the algorithm, then 
comment on how it can be efficiently implemented. 

The Algorithm 

1. Obtain a strict solution to the LP: xs ± = ct and xs 2 = 1 — a. Let k\ = \S\\ and k 2 = \S 2 \. 

2. Find S' C S 2 , \S'\ = k such that v(S') > fcv(S 2 ). 

7 



3. Find S" C S 2 - S u \S"\ =k-h, such that u(5"|Si) > rJM^OS^i). 

4. Output max(v(Si U S"),v(S')). 

As for the efficient implementation of the algorithm, we have already argued in Proposition 
that an optimal and strict solution to the LP can be found with a polynomial number of 
demand queries. Alternatively, Step Q] can also be implemented combinatorially as an ascending 
auction: start with a price per item of and increase it gradually. When supply exceeds demand, 
consider the boundary bundles, and obtain a strict solution as in Lemma 13.61 Steps [2] and [3] can 
be implemented using the following folklore lemma (see Lemma 14.51 for a proof of a more general 
setting) . 

Lemma 4.2 Let v be a submodular valuation, S be some bundle, and let t < \S\ be some integer. 
Then, there exists a set S' C S, \S'\ = t such that v(S') > jLv(S). In addition, S can be found 
using a polynomial number of value queries. 

Step [2] follows immediately from Lemma 14.21 Step [3] follows by observing that the marginal 
valuation v(-\Si) is submodular too, and applying Lemma 14.21 again. We are left with proving the 
approximation ratio of the algorithm: 



Lemma 4.3 Let A be the bundle that the algorithm outputs. Then, v(A) > ^(xs 1 v(Si)+xs 2 v(S 2 )). 

IS2-S1I 



Proof: Recall that v(S"\Si) > J ^ 1 v(S 2 \S 1 ). That is (also using \S 2 - Si\ < k 2 ): 



v(S"uS 1 )-v(S 1 ) > ^-^(v(S 2 US 1 )-v(S 1 )) 

K2 

Rearranging and using v(S 2 U S\) > v(S 2 ) (since v is monotone) we have: 

V(S"US 1 ) > k -^v{S 2 ) + kl + ** ~ k v(S 1 ) (1) 

K 2 K 2 

We are finally ready to prove the approximation ratio: 

a ■ v(Si) + (1 - a) ■ v(S 2 ) = a- — — r(— — r^ v(S{) H : — -v(S : 

k\ + k 2 — k \ k 2 k 2 

+{i - a - a kXk 2 kl -k )v{S2) 

* % +1 - k V ^ Sl U S " ] + (1 " ° ~ % \~k 2 kl - k MS2) 

< j-max(v(SiUS"),v(S')) 

where the second inequality is due to (P). It remains to bound the value of 7 (the proof can be 
found in the appendix): 

Claim 4.4 Let 7 = max fel < fc<fe2 a^^ + (1 - a - a-^g^)^. 7 < §. 

□ 



4.1 A (| + e)- Approximation Submodular Valuations Subject to a Knapsack 
Constraint 

The Algorithm 

1. For each set L, \L\ < \ such that C(L) < B, and each set V C L, \L'\ = e ■ \L\: 

(a) Let T = L - V . 

(b) Define a new valuation v L ' L ' (S) = v(S\T). Let a = mmj eL Cj. Let M L > L ' = M -T - 
{j\cj > e ■ a}. 

(c) For the set of items M L,L , obtain a strict solution to the LP w.r.t. v L,L and budget 

B L,L> =B _ C ( T ). X L,L> = aLM and x L,L> = ± _ qLiL /_ 

(d) Find 5' C S 2 , C(S') < B L > L ' such that v L ' L ' \S') > ^^- v(S 2 ). If there is no such 
S' let A ' = and continue to the next iteration. 

(e) FindS" C 52-51, C(S') < S L ' L '-C(5i), such that v L > L ' (5') > ^^j^^-A v L ' L ' (S 2 ) 
If there is no such S' let A ■ = and continue to the next iteration. 

(f) Let A L > L ' = arg max(u(T U Si U 5"), v(T U S')). 

2. Output argmax^ -y v(A L ' L ). 

Notice that if e is constant then there are only polynomially many iterations. Since each iteration 
needs polynomially many demand queries, the total number of demand queries is polynomial too. 
We will use Lemma r4.5l to implement Steps (|ld|) and (fTe)) . similarly to the algorithm for a cardinality 
constraint. (Notice that v L,L is a submodular valuation.) 

Lemma 4.5 Let v be some submodular valuation, and S be some bundle. Then, there exists a 
chain 5i C . . . C 5|s|-i Q S\s\ = S, where \St\ = t and v(St) > (jmy v (S) f or every t. 

Proof: We prove the existence of St for t = \S\ — 1. The lemma will then follow as it implies 
that we can find 5i C 52 C . . . C 5igi_i C S\$\ = 5, where \St\ = t, and for each I, \Si\ + 1 = |5/+i| 
and v(Si) > g/g \ v(Si+x)- Now we will have that 

, c w C(S t ) , , C(S t ) C(5 t +i) C(5|5|_i) C(S t ) , , 

Notice that given v(Si) we can w(5/_i) by considering the I subsets of size I — 1 and taking the one 
with the highest value. 

We now prove the lemma for t = \S\ — 1. We have that 

\s\ 
v(S) = J>({j}|{i,---,i-i}) 

\s\ 

where the inequality holds because v is submodular and has decreasing marginal utilities. In 
particular we have that for some item j, v({j\S — {j}}) < (jr$], i-e., v(S — {j}) > C ,^P v(S). 
Let S' = 5 — {j}. This completes the proof of the lemma. □ 
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We only analyze one particular iteration, when L is the set of the \ items with the highest 
costs in the optimal solution. Furthermore, let ai, ..., a\n be some order on the items of L so that 
for every i, v(di\{l, ....,aj_i}) > u(aj + i|{l, ...., aj}). Such order can be obtained by starting from 
the empty set and greedily taking the item from L with the highest marginal contribution that 
has not been taken yet. Let L' = {a(i_ e )i_L|, • • • cl\l\}- Observe that by submodularity the value of 
the optimal unrestricted solution in M ' U T is at least (1 — e)OPT, where OPT is the value of 
the optimal solution. Also notice that for each item j £ M L)L we have that c,- < eB L,L since 

D ' > \h | • Cj. 

For Step (|ldp note that for some St we have by Lemma [4 . 5 1 that C(St) < B L,L and v L,L (S') > 

— r*(a \" v(S 2 ). Since for each item j € M ' we have that Cj < eB L,L we immediately get 

C(St) > B L,L (1 — e) and Step (jldj) follows. Step (fTe]) follows by observing that the marginal 
valuation v L,L (-\Si) is submodular too and applying Lemma 14.51 similar to Step (jldp . 

Lemma 4.6 T ^-^ L '(^ L ') > xJ; L 't; L ' L '(5i) + Xgf v L ' L ' (S 2 ). 

Proof: Recall that v L > L '(5"|<Si) > (B c^l ) ^ 1 ) ~'° ^ L ' L ' (ff? |fft ) ■ That is (also using C(5 2 - 5i) < 
C(S 2 )): 

v^'(S"uS 1 )-v L ' L '(S 1 ) > {B ~ C ^J\ {1 ~ e) (v L > L '(S 2 U 50 - ^(ft)) 
Rearranging and using w ' (52 U Si) > u ' (5 2 ) (since u is monotone) we have: 

,"'(s"u Sl ) > ( B c ( s!f ) " L ' L ' (52> + C(Sl> cSf ' " B ' M ' I - S ^ 1 - g > < 2 > 

a .^(5 l) + (l-a).^(ft) - ° c(Sl) ^ ) _ J> ( C(Sl) ^f ) - B ^'W) 

C(5 2 ) r; L ' L '(5iU5") 

< a- 



^-»-»5irari^'*) 



< a 



C(S 1 ) + C(S 2 )-B 1-e 
g-C(5i) 
a C{S 1 ) + C(S 2 )-B 

C{S 2 ) v L > L '{Si\JS") 

C(5i) + C(5 2 ) - 5 1-e 

fl-C(Si) C(5 2 )^ L ' L/ (5Q 

C(5!) + C(5 2 )-B j 5 1-e 



+(1 — a — a 



C(g 2 ) B-C(5i) N C(5 2 

— V a 777"5 TTTa d + V- ~ a ~ a ~ 



'C(Si) + C(S 2 )-B v C(Si) + C0S 2 )--B' 5 

max(t; L ' L, (5 1 U5 // ),i; L ' L, (5 / )) 
1-e 

< _^_ . max(/' L '(5i U S"),v L ' L '(S')) 
1 — e 

where 7 showed to be at most | in Claim [4~4~1 □ 

Recall that we lost at most e • OPT by discarding items in L'. We therefore have that the value 
" 1- 
9 
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of the solution is at least q (1 — e) • OPT. 



5 A 2- Approximation for Subadditive Valuations 

We show that there exists a 2-approximation algorithm for maximization subject to cardinality 
constraint. This is the best ratio achievable with a polynomial number of demand queries even if 
the valuation is XOS, as we show in Section [6l While this is only a slight improvement over the 
(2 + e) approximation algorithm for the setting of [9], we then show how to extend this algorithm to 
provide a (l + y^)-approximation for maximization subject to /c-knapsack constraints. In particular 
this implies that there exists a (2 + 0(e))-approximation algorithm for maximization subject to a 
knapsack constraint (k = 1). Previously, the best bound was O(logn) [9]. 

Both algorithms provide the same approximation ratio also for non-monotone subadditive valu- 
ations, not just monotone ones. In the appendix we show that when the valuation is non-monotone 
and submodular, then the integrality gap is 2. 

Theorem 5.1 The following two algorithms exist: 

• A 2-approximation algorithm for maximizing a (not necessarily monotone) subadditive func- 
tion subject to a cardinality constraint that uses polynomially many demand queries. 

• A (1 + tzz)- approximation algorithm for maximizing a (not necessarily monotone) subadditive 
function subject to k-knapsack constraints that uses polynomially many demand queries, for 
every constant e > and constant k. 

We start with the first algorithm, which uses a simple rounding scheme. 

The Algorithm 

1. Obtain a strict fractional solution x$ 1 = a and x$ 2 = 1 — a. 

2. Arbitrarily divide 52 into sets U\, . . . ,Ui such that for each i < I, \Ui\ = k and \Ui\ < k. 

3. Output A = axgmax(v(Si),v(Ui), . . . , v(Ui)). 

Notice that the above algorithm can be implemented with a polynomial number of demand queries. 
Lemma 5.2 Let A be the bundle that the algorithm outputs. Then, 2v(A) > xs 1 v(Si) + xs 2 v(S2)- 
Proof: 

x Sl v(Si) + x S2 v(S 2 ) < x Sl v(S 1 )+x S2 -l-max(v(Ui),...,v(Ui)) 

< (xs 1 +xs 2 ■ I) m&x(v(Si),v(Ui), . . . ,v(Ui)) 

< {x Sl +xs 2 {^ + l))v{A) 

< (i + xg JM)v(A) 

< (l + l)v(A) 

= 2v(A) 

where the first inequality holds by subadditivity ^(£2) < J2i=i v (Ui), the third uses I < \-jf\, the 
fourth inequality uses xs t + x$ 2 < 1, and the last inequality holds since by the LP we have that 
#s 2 1 52 1 < k. □ 
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5.1 An Approximation Algorithm for Subadditive Valuations Subject to k- 
Knapsack Constraints 

In this section we study maximization subject to k knapsack constraints. In this problem we have 
a valuation v and k costs for each item j: c\, . . . , c\. Let Ci{S) = Sj G 5cV We also have k budgets 
B\, . . . ,.Bfc. The goal is to find a maximum- value bundle S such that for every i, Ci(S) < B^. 

We note that ^fj-approximation algorithms exist for maximizing a montone submodular valu- 
ation subject to k knapsack constraints (the algorithms use only value queries) [18] (note that 
our algorithms are for the more general subadditive case) . Consider a generalization of the LP for 
a single knapsack constraint: 

Maximize: ^2 S xs ■ v(S) 
Subject to: 

• For each constraint i G [A;]: ^2s x s ' Ci(S) — &i- 

• Y,s x s < !• 

• For each bundle S: xs > 0. 

Proposition 5.3 The LP can be solved with a polynomial number of demand queries. 

Proof: Once again we take its dual and give a separation oracle to the dual to solve the LP. 

Minimize: X^t=i Vi ' ^i + z 
Subject to: 

• For each bundle S: z + Y2i=i Vi ' Q(S) > v(S). 

• For each constraint i G [k]: y%~> 0. 

• z > 0. 

Similar to the case of single knapsack constraint (Proposition 13. 1| ) we can solve this dual LP by 
ellipsoid method. The separation oracle for the dual is a demand query maxy v(T) — J2i=i Vi ' Ci (T) . 

□ 
The final algorithm uses enumeration over "big" items. 

Definition 5.4 An item j is called big if & > e • Bi for some constraint i G [k]. An item is called 
small otherwise. 

Let B the set of big items and W be the set of small items. 

The Algorithm 

1. For each set T C B such that for each constraint i £ [k]: Ci(T) < B^. 

(a) Let M' = T\JW. 

(b) Obtain fractional solution on items from M' . 

(c) Divide each bundle S in the fractional solution into sets, Iff ,11^ , ■ ■ ■ ,U t s sets each 
satisfying budget constraint each Uf respects all budget constraints. Additionally 

12 



(d) Let A T = argmax(fTf). 
2. Output argmax^c_B w(t4 t ). 

Notice that Step (fTc|) can be implemented for each S as follows: put the subset T C\S in t/-f and 
add items from 5 without violating the budget constraint of Uf . Now divide the rest of the items S 
into bundles Uf, U® ', ■ ■ ■ , U L S so that each such bundle respects the budget constraint and for each 

i, Bi — Ci(Ur) < e • B L . Since we only have to handle small items, we get that lg < |~X]i=i g-(i- e i l ■ 
As for the number of demand queries we make, notice that in each set T we consider all items 
are big. Therefore, for this set to respect each of the budget constraints it must be that \T\ < k/e, 
which implies that the number of iterations we make is at most to"? . Since in each iteration we 
make a polynomial number of demand queries, if e is constant the total number of queries we make 
is indeed polynomial. 

Lemma 5.5 Let A be the bundle that the algorithm outputs. Then, (1 + jzz)v(A) > ^2s XsV (S)- 

Proof: Consider the set A that was obtained in the iteration where T is exactly the set of big 
items in the optimal solution O. The optimal fraction solution with respect to WL)T has the same 
value as the unrestricted fractional solution. We can therefore analyze the approximation ratio for 
this A T . 

Y, x sv(S) < ^X5-/5-max( W (C/f),«(L7 2 5 ),...,^)) 
5 S 

< v(A T )Y,*s-ls 
s 

<- ^XXE^d 



k 



Ci(S) 



k 

= ^ T )(i+E^— {L*scm 

i=l iy ' s 
«=1 ' 



< v(A T )(l+ ' 



l-e' 

where the second inequality holds since by subadditivity v(S) < T> l i=1 v(Uf), and the second to last 
inequality holds since Y^s x sCi(S) < Bi (by the constraints of the fractional solution). □ 
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6 Lower Bounds 

6.1 A Tight Lower Bound for XOS Valuations 

We show that our algorithms from Section [5] are essentially tight: an approximation ratio of 2 — 
e requires exponentially many demand queries. We note that proving bounds on the power of 
algorithms with demand queries turned out to be not an easy task, and in particular very different 
than showing lower bounds on the power of value queries. For example, when we consider value 
queries there are only finitely many value queries that we have to consider (no more than the number 
of subsets of M), whereas there is an infinite number of demand queries we have to consider. The 
crux of our proof is to show that the power of any arbitrary demand query is limited in some formal 
sense, hence exponentially many demand queries are needed to distinguish between the case that 
the optimal value is 2, and between the case it is 1 + e. 

We note that that our bound holds also for randomized mechanisms, and in fact holds also for 
a the class of fractionally subadditive valuations, a strict subclass of subadditive valuations. 

Theorem 6.1 Let A be a randomized algorithm that achieves a (2 — e)- approximation, for some 



etc 



fixed e > 0. Let a be such that m = k a . A makes in expectation at least — ac ac- demand 

m(» )TOT(2e) fc -TTO 

queries, even if the valuation is XOS. 

In particular, fix some e, 7 > 0, and let k = m 1 ^ 7 . The theorem says that obtaining a 2 — e 
approximation requires exponential number of demand queries. The following three families of 
additive valuations will be used in the proof: 

1. For every item j, define the valuation Ij such that Ij({j}) = 1 and for every t 7^ j , Ij ({t}) = 0. 

2. For every subset T, \T\ = k, , define the valuation Gt such that Gt({J}) = \ if j E T, and 
for every j £ T, G T ({j}) = 0. 

3. The valuation B such that for every item j, B({j}) = -rp. 

For every T, \T\ = k, let vt(S) = max(/i(5), . . . , I m (S), B(S),Gt(S)). In addition, let v$(S) = 
max(Ii(if?), . . . , I m (S),B(S)). Notice that the valuations are XOS (i.e., fractionally subadditive) 
by definition. We will prove that: 

Lemma 6.2 Determining whether the valuation is v$ (and not vt, for some T) requires in expec- 
tation at least — tt. ■ — tt- demand queries. 

m (^)Tm (2e) k ~ WU 

Lemma 16.21 implies Theorem 16.11 the bundle T is of size k and vt(T) = 2. On the other hand, for 
every bundle S of size k it holds that vq(S) = 1 + e. 

Proof: Specifically, we show that any deterministic algorithm must make in expectation the 
specified number of demand queries to determine if the valuation is v®, when the valuation is 
chosen uniformly at random from the set {v(i)}L)>j>:\T\=k v T- Yao's principle delievers the lemma now. 
We use the following definition: 

Definition 6.3 Fix a demand query dq = (pi, ...,p m ). We say that dq covers vt if the demand set 
of dq in vt contains a set S such that Gt is the maximizing clause of S. 
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Claim 6.4 Let dq = (pi, ...,p m ) be a demand query, and let vt be a valuation that is covered by 
dq. Let S CT be some bundle in the demand set of dq in vt such that Gt is the maximizing clause 
of S. Then, T,j e sPj < -\r- — 1 + §. Furthermore, we have that \S\ > \ — 1. 

Proof: Let t = argmiiij^s Pj- Gt (and not It) is the maximizing clause for S, and thus: 

2151 
G T (S) - ZjesPj = —r ^jesPj > 1 - Pt = h{t) - Pt 

Since S is in the demand set and Gt is its maximizing clause, for each j € S, Pj < -j- (otherwise 
S — {j} is more profitable than S, and thus S is not in the demand set). 

2151 „ 2 

-U - E,. 6aPi > 1 - - 

9l S 1 ! 9 

Reorganizing we have that -j^- — 1 + 4 > Yij^sPj, as needed. As for the second part of the claim, 
notice that if |5| < ^ — 1 then vt(S) = Gt(S) < 1 — ^, and therefore Gt is not the maximizing 
clause of S since Irit) — Pt < 1 — t- D 

The key observation is that if vt is not covered by dq, then the demand set of dq is identical in 
vq and vt- In particular, the only information that executing dq adds is either to determine that 
the valuation is some specific vt (in case vt is covered by dq) or to claim that the valuation is not 
any of the vt's that are covered by dq. However, to determine whether the valuation is v^, we need 
to rule out all possible values of T. The heart of the proof is the following claim: 

Claim 6.5 Fix a demand query dq = (p±, ...,p m ). The number of bundles that dq covers is at most 

4k ^ ek 

100 100 

Proof: We upper bound the number of valuations Vt that dq covers by describing a set L of items 
of size at most \L\ < -j with the property that for every vt that is covered by dq, \LC\T\ > j^. 
The number of these bundles is at most: 



k 

Ei 


(!) 


(V-f) 


i < i 


(i) 


f m ~m 
V k- S, 


,■_ efc 


\ / 


\ / 




M00 7 


^^ 100 


100 













We now describe a process that constructs the set L. After that, we prove that L is indeed of 
the specified size. 

1. Let Lq = 0, T = {T\vt is covered by dq}, and i = 0. 

2. While T + 0: 

(a) Let i = i + 1. 

(b) Select some Tj e T. 

(c) Let SV. be a set in the demand set of dq in vt that is maximized in the clause Gt- 

(d) Let L i = L i - 1 US Tl - 

(e) Let T = {T|wr is covered by dq and |Lj D T\ < ^q}. 

3. Let L = L~. 
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We now show that \L\ < — . Specifically, we show that if the number of iterations t is more 
than - then the profit of L is at least 2. This means the demand set does not contain bundles 
of size at most k at all, since their value is at most 2. Hence dq covers no valuation vt (i-e., 
v(L) — Hj^LPj > v(T) — Y,j£TPj for every bundle T of size at most k). Thus, if dq covers some 
valuation vt it must hold that t < | . 

For each iteration i, let S% = Li — Lj_i. Observe that by Claim WM |5rJ > § — 1 and therefore 

l^il > 2 ~~ 1 ~~ uto" From the same claim we also have that Y,j & s T .Pj < — £p — 1 + § • Together this 

implies that E jeSi Pj < 2{{Stl ^ ) - 1 + § . 

We would like to bound the number of iterations £ the process goes on. By our discussion above, 
the process must stop before the profit of L is bigger than 2 (i.e., v$(L) — "EjPj > 2): 



v$(L) - Ejpj 



0- + e)\L\ 



> 



> 



> 



k 




- ^j&i 


^ 












(l + < 


k 




^<i 


s ies^j 










(l + < 






Sj<t 


91 <?-l 
1 fc 
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- e)Sj< t 


|5i| 
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-6)-t 










£-(e- 


c 

'Too 


-s> 














e 
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where the second to last inequality follows since for each i, \Si\ < |Tj| < k. Therefore for the profit 

of L to be at most 2 it must hold that t < -. Recall that any iteration we are adding to L at most 

k items. Therefore |L| < t ■ k < ^. D 

Claim [631 implies Lemma [6.21 the total number of bundles of size k is (Tj • To rule out at least 

^rp- possible bundles, the number of demand queries d we have to make is at least (we use the 
bounds (™) > (Z) r , (?) < (Jf Y and use m = k a ): 



1 /fc a \ 

2 ' I fcj 



2 



4fc . _i, a e-fc 



fc a - 



> 



(A) ' ( fc_Ji ) 

100 100 



1 fc afe 

2 ' ~W 




4fe efc j, a e-fc , 

100 100 


efe 
' 100 



1 . jfcfc(a-l) . (jfc _ ^) fc " — 



, _- efe 



efe , . ,i, £fe 



> 



(420e)^j( eA .a)fc-^j 
1 . k k(a-l) . ^-^ 

^)w(2eA; a ) fe -w 



1 uk-a 
2 



e-fc 



/c K -°-Too 
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(4Q0e)w(2e)* :: ^ 
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Therefore, until we rule out at least half of the bundles, any additional demand query finds T with 
probability at most -7. To rule out half of the bundles we have to make at least d queries, hence 
after — queries we find T with probability at most o(l). □ 

6.2 Ruling Out an FPTAS for Submodular Maximization Subject to a Knap- 
sack Constraint 

We show that there is no FPTAS for the problem of optimizing a submodlar function subject to a 
knapsack constraint (an FPTAS is a (1 + e)-approximation algorithm that the number of demand 
queries it makes is poly(m, ^)). 

m 1_ 

Theorem 6.6 Let A be a randomized algorithm that achieves an -^ — f -approximation. A makes 

in expectation at least — ■ f^J demand queries. 

4 

Notice that the lower bound on the approximation ratio depends polynomially on m and there- 
fore an FPTAS must achieve a better ratio in time poly(m, -). This shows that an FPTAS for this 
problem is impossible. For proof, we consider the following family of instances. Let A be some 
set of y items, and let B be the set that contains the rest of the items. For each item j E A let 
c i = Jr — e > an d for each item j £ B let c? = J- + e. Let the total budget be 1. For every T of size 

•J Til <J Til 

77 such that \T n A\ = ^ define the following valuations: 

f |5|, |S|<§; 

m I 01 - m. 

f, \S\ = f,C(S)>l; 

m l \S\=T: 



v T (S) 



2 3' 
m 1 

2 2' 



otherwise. 



f \S\, |5|<9; 



MS) = { 



2 

2 ' 1° I ■> 2 ' 

m 



2 ' 1^1 2 

m 1 

2 2' 



S\ = f,C(S) >1; 



otherwise. 



Lemma 6.7 Determining whether the valuation is v$ (and not vt, for some T) requires in expec- 
tation at least — ■ {? n ) demand queries. 



in 



Lemma 16.71 implies Theorem 16.61 if the valuation is vt then vt(T) = y — 3. Otherwise, for every 
bundle other 5 of below the budget it holds that v$(S) < y — 5- Proof: We use the following 
definition: 

Definition 6.8 Fix a demand query dq = (pi, ...,p m ). We say that dq covers vt if the demand set 
of dq in vt contains T. 

Claim 6.9 Let dq = (pi, ...,p m ) be a demand query, and let vt,Vt' be two valuations that are 
covered by dq. Then either T D A = T' D A or T n B = T' (~l B . 

Proof: Suppose not. Let a,b £ T and a',b' £ T' be such that a,b ^ T' , a',b' £ T, a, a' € A, 
b, b' € B. Define the following bundles: 

T b , =T-a + b',T' a = T' -b' + a 
17 



If the valuation is vt, then T is in the demand set and therefore vt(T) — p(T) > vt(Tw) — p{Ty). 
Since C(Tb) > 1, we have that | < py — p a . 

If the valuation is vt>, then we have that vt>{T') — p(T') > VT'{T' a ) —p(T' a ). Since C(T' a ) < 1 
we have that \ > Pv ~ Pa- We have reached a contradiction and the claim follows. □ 

Observe that if vt is not covered by dq, then the demand set of dq is identical in v$ and vt- In 
particular, the only information that executing dq adds is either that the valuation is some specific 
vt (in case vt is covered by dq) or provide a proof that the valuation is not any of the vt's that are 
covered by dq. However, to determine whether the valuation is vq, we need to rule out all possible 
values of T. Suppose that we have d demand queries that fail. There are (£J • f £J possible value 

4 4 

of T (half of the items in T come from A and the other half from B), and by the claim each 
demand query can rule out at most f £J (we keep all items in, say, A, and choose ^ items from B). 

4 

Therefore, until we rule out at least half of the bundles, any additional demand query finds T with 
probability at most -4- . To rule out half of the bundles we therefore have to make in expectation 



T 



at least (^,) queries, hence after — • (j,) queries we find T with probability at most o(l). □ 

4 4 
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A Appendix for Section [4] 

Proof of Claim 14.41 

The proof is basically an algebraic manipulation: 

k 2 tl . k-ki k 2 

7 = max a-- ; + ((1 — a) — a ■ ; r J — 

k!<k<k 2 k\ + k 2 — k ki + k 2 -k k 

k 2 — k k 2 k — k\ k 2 — k k — k\ k 2 

ki<k<k 2 k 2 — k\ k\ + k 2 — k k 2 — k\ k 2 — k\ fci + k 2 — k k 

k 2 -k k 2 k-k x k-ki k 2 

T"Y~l O "V - . . i I I I . 

k\<k<k 2 k 2 — k\ k\ + k 2 — k k k 2 — k\ k 

k 2 — k k 2 k\ k — k\ k 2 

fci<fc<A!2 k 2 — k\ k\ + k 2 — k k k 2 — k\ k 

k 2 k(ki + k 2 ) -k 2 -k\ 

k^<k<k 2 k{k 2 — k\) k\ + k 2 — k 

k 2 , n k\ 
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k\<k<k 2 {k 2 — k\) k(k\ + k 2 — k) 

max-- — • (1 — — — ■?) (3) 

k 1 <k 2 (k 2 -k 1 ) {ki + k 2 f 



max- 



k 2 k\ + 2kik 2 - 3kf 



ki<k 2 (k 2 - hi) (h+k 2 ) 2 

k 2 {k 2 + 3k 1 )-(k 2 



max- 



ki<k 2 (k 2 - ki) (h+k 2 ) 2 

{k 2 + 'ik 1 )-k 2 



max- 



ki<k 2 (fci + k 2 
(x + 3) • x 



1 2 



= max- . 

^>i (x + l) 2 

9 

8 

where in ([3]) we use the fact that the expression is maximized at k = ^ 2 . In the second to last 
equation we set x = j?. 

B Integrality Gaps 

An Integrality Gap of | for Monotone Submodular Valuations 

Theorem B.l There exists a monotone submodular valuation v for which the integrality gap for 
maximization subject to a cardinality constraint is I. 

Proof: Towards defining the valuation v, consider a six-element universe U = {ei, . . . , e%}. Define 
the following four sets: m\ = {ei,e 2 ,e3}, m 2 = {ei,e4}, 7713 = {e2,es}, m^ = {e3,es}. Now define 
the following valuation where the set of item is M = {mi, m 2 , 1713,1714,}. Let v be the following 
valuation: v(S) = \ U m . g 5 m,|, i.e., the number of elements in U that the union of the sets in S 
covers. This valuation is submodular. 

Now let the cardinality constraint be k = 2. The optimal solution is to take any set S of size 2. 
The value of the optimal integral solution is 4. On the other hand, consider the following fractional 
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solution: x mi = \ and x m2 , m3 ,m 4 = \. The fractional solution respects the cardinality constraint 
and has a value of 4.5. The integrality gap is therefore |. □ 

An Integrality Gap of 2 for Non-Monotone Submodular Valutions 

Theorem B.2 For every constant e > 0, there exists a non-monotone submodular valuation v for 
which the integrality gap for maximization subject to a cardinality constraint is 2 — e. 

Proof: Let the items be {1, . . . , k 2 + l}. Define the following non-monotone submodular valuation: 



v(S) = ^ ' *■- ■ 



!.-§, SC{2,3,...,k 2 + l},leS; 

F , SC{2 1 3,..,fc 2 + l}. 



[ Jf, SC{2,3,...,k 2 

Then the optimal integral solution has a value of 1, whereas the fractional solution im = rrx, 
x {2,3,...,fc 2 +i} = \ nas value of 1 • ^pj + k 2 ■ -A^ = -^j. As k tends to infinity the integrality gap 
tends to 2. □ 
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